Multiple queue bandwidth reservation packet system

ABSTRACT

A multiple queue packet bandwidth reservation arrangement is disclosed in which statistical type packets are scheduled for transmission and a prescribed interval is reserved for transmission of periodic type packets for each scheduled statistical packet. Each arriving statistical packet is assigned a scheduled time of service based on the amount of packet information already queued to be supplied as an output and the duration of any intervals reserved for transmission of periodic packets at an assigned output port. Operation of the bandwidth reservation arrangement is such that normally a statistical packet is not delayed from being transmitted at its scheduled time of service for more than an interval needed to transmit a maximum length periodic packet.

CROSS-REFERENCE TO RELATED APPLICATION

U.S. patent application Ser. No. 371,236; Ser. No. 371,229; Ser. No.371,233; Ser. No. 371,232; Ser. No. 371,237; and Ser. No. 371,570 werefiled concurrently herewith.

TECHNICAL FIELD

This invention relates to packet transmission systems and/or switchingsystems and, more particularly, to the prioritizing of packets fortransmission.

BACKGROUND OF THE INVENTION

In prior packet transmission systems and/or switching systemsinformation being transmitted was classified as being eitherstatistical, i.e., bursty information or periodic, i.e., so-calledcircuit type information. An example of the statistical information isdata transfer between computers or the like. An example of periodicinformation is PCM encoded voice signals. In the prior packet systems,packets including periodic information (periodic packets) were givenpriority over packets including statistical information (statisticalpackets) for transmission in order to minimize any possible delayvariation. Statistical packets were transmitted only when there were noperiodic packets to be transmitted. Consequently, the statisticalpackets either experienced long delays in transmission or were dropped.Both of these results are undesirable.

More recently, it has been suggested to assign a small portion of thetransmission bandwidth for the transmission of statistical packetswhether or not higher priority periodic packets are present fortransmission. Specifically, an interval T₁ of a frame is assigned fortransmission of periodic packets and a much smaller interval T₂ of theframe is assigned for transmission of statistical packets. A limitationof such a packet transmission arrangement is that there is no way toknow or estimate the delay in transmission experienced by thestatistical packets.

SUMMARY OF THE INVENTION

Problems associated with priority of transmission and/or switching ofperiodic packets and statistical packets are mitigated, in accordancewith an aspect of the invention, by employing a packet transmissionand/or switching arrangement in which statistical packets are scheduledfor transmission and a prescribed interval is reserved for transmissionof periodic packets for each scheduled statistical packet.

More specifically, a scheduled time of service, i.e., transmission, isgenerated in an output port for each arriving statistical packet basedon the amount of all packet information waiting to be transmitted andthe duration of intervals reserved for transmission of periodic packetinformation. The duration of the interval reserved for transmission ofperiodic packets is determined in accordance with the length of thecorresponding statistical packet and a so-called reservation factor. Thereservation factor, in this example, is representative of the amount ofperiodic packet information being transmitted at the correspondingoutput port.

In accordance with another aspect of the invention, the value of thereservation factor is dynamically updated based on the actual amount ofperiodic packet information being transmitted at the particular outputport during a prescribed measurement interval. More specifically, thevalue of the reservation factor is dynamically updated by obtaining asmooth estimate of the number of words of periodic packet informationbeing transmitted at the output port during the prescribed measurementinterval.

Operation of an embodiment of the invention is such that normally astatistical packet will not be delayed from being transmitted at itsscheduled time of service by more than an interval needed to transmit amaximum length periodic packet. Statistical packets, however, are nottransmitted prior to the occurrence of their corresponding scheduledtime of service. If there is time reserved for transmitting periodicpackets and no periodic packets are available, so-called stuff packetsare transmitted until the next scheduled time of service occurs for thenext statistical packet to be transmitted. Additionally, if there arestatistical packets present to be transmitted, periodic and/or stuffpackets are not transmitted unless there is time reserved for suchtransmission.

BRIEF DESCRIPTION OF THE DRAWING

In the Drawing:

FIG. 1 shows details, in simplified block diagram form, of a packetnetwork node including aspects of the invention;

FIG. 2 depicts a packet format, illustrating an aspect of the invention;

FIG. 3 graphically illustrates a packet transport word, i.e., header,useful in describing an aspect of the invention;

FIG. 4 depicts a packet transport word including aspects of theinvention;

FIG. 5 shows details, in simplified block diagram form, of input ports104 employed in the packet cross-connect 103 of FIG. 1;

FIG. 6 depicts a flow chart illustrating operations performed in control504 in controlling input port 104 of FIG. 5;

FIG. 7 shows details, in simplified block diagram form, of output ports110 employed in packet cross-connect 103 of FIG. 1;

FIG. 8 depicts a sequence of timing diagrams useful in describing theoperation of packet cross-connect 103 of FIG. 1 and output ports 110 ofFIG. 7;

FIG. 9 shows another sequence of timing diagrams also useful indescribing the operation of packet cross-connect 103 of FIG. 1 andoutput ports 110 of FIG. 7;

FIG. 10 depicts details, in simplified block diagram form, ofreservation factor calculator 716 used in output ports 110 shown in FIG.7;

FIGS. 11, 12, 13, 14 and 15 when connected A--A, B--B, C--C, D--D, E--E,F--F, G--G, H--H, I--I, J--J, K--K and L--L form a flow diagramillustrating operations performed by scheduler 113 in packetcross-connect 103 of FIG. 1; and

FIG. 16 shows a packet network arrangement in which packet network node100 including aspects of the inventions may be advantageously employed.

DETAILED DESCRIPTION

FIG. 1 shows details, in simplified block diagram form, of packetnetwork node 100 for interconnecting a plurality of incoming ports to aplurality of outgoing ports. Such packet network nodes may beadvantageously employed in a network as shown in FIG. 16 and describedbelow. Accordingly, signals from a plurality of sources are supplied viaterminals 101-1 through 101-(X+Y) to packet network node 100. Thesources may be, for example, broadband packet transmission facilities,digital data, RS232, DS0, DS1, DS3, other digital signals, other packetsignals, e.g., LAPD (Link Access Protocol D channel), broadband packetsof a type similar to those disclosed herein or the like. These signalsmay be analog or digital at any desired rate. For example, the incomingsignal bit rates could be the 64K bit/sec DS0 rate, the 1.544 Mb/sec DS1rate, or a 150 Mb/sec transmission rate including packet formattedinformation, or any higher or lower rate, as desired.

If the incoming signal is being transmitted over a digital facility andincludes packets in a broadband packet format of a type employed inpacket network node 100, it would be supplied to one of facilityinterfaces 102-1 through 102-X. Input facility interfaces 102, in thisexample, are employed to supply the packet information a byte at a timeto packet cross-connect 103 and, therein, to a corresponding one ofinput ports 104-1 through 104-X. Such facility interfaces are known inthe art and, typically, include a phase locked loop for recovering theincoming clock signal, a framer, a bipolar-to-unipolar converter ifneeded, an equalizer for the equalization of gain and/or delaydistortion, performance monitoring apparatus and apparatus forreformatting the incoming digital signal from the incoming digitalformat into the broadband packet format used in cross-connect 103 whichis supplied to a corresponding one of input ports 104-1 through 104-X abyte at a time.

In this example, packet network node 100 also includes packetizers 105-1through 105-Y. Each of packetizers 105-1 through 105-Y include an inputlocal packet interface 106 and a parity unit 107. Operation of anexemplary one of packetizers 105 in generating a packet transport word,i.e., header, and a packet format, in accordance with aspects of theinvention, is described below. It should be noted, however, thatdepending on the type of signal source being interfaced the structure ofthe particular one of packetizers 105 may vary. However, the broadbandpacket format being generated is the same for all of packetizers 105.Such packetizers may also be included in other remotely locatedequipments which supply signals to a packet network node 100 via atransmission facility and a corresponding input facility interface 102or if desired directly to one of packetizers 105-1 through 105-Y forreasons described below. It is noted that one of packetizers 105-1through 105-Y is designated a control input.

The broadband packet formatted incoming signals are supplied frompacketizers 105-1 through 105-Y to input ports 104-(X+1) through104-(X+Y), respectively. A reference code word Xref is supplied fromXref unit 108 to each of packetizers 105-1 through 105-Y, to each ofinput ports 104-1 through 104-(X+Y) and to stuff port 109. Xref unit 108may include a register or other memory device for storing a desiredreference code word. The reference code word Xref is unique to eachnetwork layer in the system hierarchy and provides so-calledtransmission transparency for all users. Additionally, private networksemploying the same broadband packet format are each assigned a uniquereference code word Xref which is used to delimit the private networkpackets and also provides transparency in the system hierarchy.

Each of input ports 104-1 through 104-(X+Y) is employed to delimitpackets, to synchronize to the incoming broadband packet format and tostore the packets which are to be obtained by appropriate ones of outputports 110-1 through 110-(X+Y), in accordance with aspects of theinvention. To this end, each of input ports 104 interfaces on asynchronous basis with packet cross-connect 103 data bus (DBUS), addressbus (ABUS) and transport bus (TBUS). These buses operate on a timedivision multiplexed basis. Details of each of input ports 104 are shownin FIG. 5 and are described below.

Stuff port 109 generates so-called stuff packets which are transmittedwhen no other packets are present for transmission. Stuff port 109generates the stuff packets in a manner substantially identical to thatemployed in packetizers 105 and described below. The stuff packets arestored in a buffer memory for use as needed. Stuff packets are requestedas needed by individual ones of output ports 110-1 through 110-(X+Y), asexplained below. To this end, stuff port 109 interfaces with the packetcross-connect 103 address bus (ABUS) and data bus (DBUS).

Each of output ports 110-1 through 110-(X+Y) is employed to supplypackets obtained from input ports 104-1 through 104-(X+Y) and stuff port109 to an appropriate one of output interfaces 111-1 through 111-X andoutput local packet interfaces 112-1 through 112-Y. For example, if thepackets are to be transmitted to a remote packet network node they willbe supplied to one of output facility interfaces 111-1 through 111-Xand, in turn, to output terminals 115-1 through 115-X, respectively. Ifthe destination of a packet is the instant packet network node 100, itwill be supplied to an appropriate one of output local packet interfaces112-1 through 112-Y and, in turn, to output terminals 115-(X+1) through115-(X+Y), respectively. As in the case of packetizers 105, output localpacket interfaces 112 may also require different structures depending onthe type of equipment that is being interfaced.

Output facility interfaces 111-1 through 111-X typically includeapparatus for interfacing output ports 110-1 through 110-X,respectively, to predetermined transmission facilities. To this end,each of output facility interfaces 111 include appropriate apparatus forformatting the broadband packets being transmitted into the particularsignal format of the corresponding transmission facility. Such outputfacility interfaces will be apparent to those skilled in the art.

To this end, each of output ports 110-1 through 110-(X+Y), inconjunction with scheduler 113, operates to schedule the transmission ofthe packets, in accordance with aspects of the invention. In order torealize these functions, each of output ports 110 interfaces on asynchronous basis with the packet cross-connect 103 data bus (DBUS),address bus (ABUS), scheduler bus (SBUS) and total quanta bus (TQBUS).Again, each of the cross-connect buses operates on a time divisionmultiplexed basis. Details of each of output ports 110 are shown in FIG.7 and are described below.

Scheduler 113, in conjunction with processor 114, operates to controlthe routing of packets from input ports 104 to output ports 110 and tostatistics port 116 and to control output scheduling of the packets atoutput ports 110 in accordance with aspects of the invention.

Processor 114 is supplied with information regarding the status ofoutput ports 110 and with delay difference (DD) values between primaryand alternate routes assigned to the destination (DEST) for theparticular packet being scheduled for transmission. Additionally,statistics port 116 supplies information to processor 114 regarding thestatus of input ports 104. In turn, processor 114 supplies thisinformation to scheduler 113.

Operation of packet network node 100 and, therein, packet cross-connect103 will become apparent to those skilled in the art from the followingdetailed description of the components thereof. It is noted, that theinputs to input ports 104 and the outputs from output ports 110 areasynchronous. However, the internal interfacing with input ports 104within packet cross-connect 103 is synchronous at a clock rate which isdetermined as a function of the number X+Y=N of input ports and themaximum transmission rate of the signals being supplied to packetnetwork node 100. In this example, a particular time slot ofcross-connect 103 timing sequence i.e., polling cycle, is employed towrite certain information in input ports 104, as will be explainedbelow. A polling cycle is completed in an interval less than a packetword interval at the maximum incoming transmission rate. Thus, in thisexample, if the maximum incoming transmission rate is, for example, 150Mb/sec, there are N=8 ports and the word length is eight bytes, therewill be 8+1=9 time slots per polling cycle and the synchronous clockrate in packet cross-connect 103 is approximately 24 Mb/sec. Each ofinput ports 104-1 through 104-(X+Y) is identified by a time slot numberin the synchronous polling cycle of scheduler 113. Specifically, thefirst time slot through the Nth time slot identify input ports 104-1through 104-(X+Y), respectively, to scheduler 113. During time slotsN=X+Y, output ports 110-1 through 110-(X+Y) have access to the memoryunits in input ports 104 and time slot N+1=0 is the time slot forwriting input word data into units in input ports 104.

Packet network node 100 may be employed in a number of applications, forexample, as a switching node, an access node or a so-called gatewaynode. However, it is important to note that the configuration ofcross-connect 103 is independent of the network configuration it isemployed in, whether the network configuration is a ring, star, mesh orthe like. A switching node would typically include a plurality of N=X-1input and N=X-1 output facility interfaces 102 and 111, respectively,and at least one packetizer 105 and a corresponding output local packetinterface 112. An access or gateway node would typically include Y=N-Xinput ports and Y=N-X output ports and at least one input facilityinterface 102 and at least one corresponding output facility interface111, i.e., X=1 and, preferably, includes Y=N-1 packetizers 105 and Y=N-1output local packet interfaces 112. For other applications, packetnetwork node 100 may include a number of input and output facilityinterfaces (X) and a number of packetizers and output local packetinterfaces (Y), where X=Y. However, any number of input facilityinterfaces and output facility interfaces, and packetizers and outputlocal packet interfaces may be employed to meet system requirements inparticular applications. It should be noted, however, for each typeinput interface there is a corresponding output interface. For example,if a digital signal is being received at this packet network node from aspecific remote switching node via one of input facility interfaces 102,a similar digital signal is being transmitted to the remote switchingnode via a corresponding one of output facility interfaces 111.Similarly, if a data signal is being received from a local area networkat one of packetizers 105, a similar data signal is being supplied tothe local area network by one of output local packet interfaces 112.That is to say, there is two-way communication between sources ofsignals being supplied to packet network node 100.

Packetizer

As indicated above, each of packetizers 105-1 through 105-Y includesinput local packet interface 106 and parity unit 107, and is employed togenerate a packet format, in accordance with aspects of the invention,as shown in FIG. 2. To this end, input local packet interface 106includes apparatus for interfacing the particular incoming signal inorder to delimit it so that the broadband packet words may be formattedin accordance with the instant invention. Additionally, buffer storageis required for the packet being formatted, a transport word generator,counters for counting the number of packet bytes and the number ofpacket words, apparatus for padding the last packet information word tobuild it out to the proper number of bytes and multiplex apparatus forcombining packet information words and the transport word to form thedesired packet. The transport word generator can be a register or a readwrite (RAM) memory unit into which the desired information is inserted.Such apparatus is known in the art.

Accordingly, shown in FIG. 2 is a packet format including transport word(header) 201 and a number of information quanta, i.e., information words202-1 through 202-M. Details of the transport word are described belowin conjunction with FIGS. 3 and 4. The instant packet format including anumber M of information words 202, each having a relatively short fixedlength, is particularly advantageous toward efficient packettransmission and/or switching. Prior arrangements used either totallyvariable length information fields delimited by flags, or a fixed lengthinformation field. The arrangements using totally variable lengthinformation fields are undesirable because they use so-called bit levelprocessing, and the arrangements using fixed length information fieldsare undesirable because the length of the information field is eithertoo long or too short. Use of a fixed length information field alsorequires that the entire information field be transmitted or switchedeven when only one byte of information is present. In the instantarrangement, only a number M of the relatively short information wordsare transmitted or switched as determined by the number of bytes ofinformation to be included in the packet. Then, only the lastinformation word in the packet may have to be padded to include bytesnot used for information in order to build out the last word to itsproper length. As shown in FIG. 2, information word 202-M, in thisexample, includes five bytes of user information and three bytes whichhave been padded and include so-called fill. In this example, not, to beconstrued as limiting the scope of the invention, the number M of packetinformation words can be zero (0) to 255, each packet information wordincludes eight bytes and each byte includes eight bits. Although thebytes of information are shown as being in parallel, it will be apparentthat they could also be arranged in series. The packet format as shownin FIG. 2 is formed by packetizers 105 in a manner that will be apparentto those skilled in the art.

Input local packet interface 106 also partially generates transport word201 as shown in FIG. 3. In this example, transport word 201 alsoincludes eight bytes with each byte having eight bits. Again, althoughthe transport word bytes are shown as being in parallel they couldequally be arranged in series. Thus, the transport word is the same sizeas each of the packet information words and will appear as such ifsupplied as an input to one of packetizers 105. BYTE (0) through BYTE(3) are employed for system address purposes and are designated thesystem address field. In this example, bit positions designated DEST (0)through DEST (11) form a destination field and are used to identify apacket network node address. As will be apparent to those skilled in theart, the bit positions designated VCID (0) through VCID (19) may be usedto further identify the final destination of the corresponding packetand represent a so-called virtual circuit identification. In thisexample, bit positions VCID (16) through VCID (19) are designated adestination extension (DEST EXT) field. If the destination of the packetis the instant packet network node, the DEST EXT field indicates whichone of output ports 110-(X+1) through 110-(X+Y) is to be supplied withthe packet. The remaining VCID bits are employed to identify the finaldestination of the packet and for billing purposes.

BYTE (4) includes bit positions designated TYPE (0) through TYPE (4) andBKG (0) through BKG (2). Bit positions TYPE (0) through TYPE (4)indicate the class or grade of service assigned to the correspondingpacket and is designated the type of packet field. Bit position TYPE (0)indicates if the packet is alternate routable. Thus, a logical 1 in bitposition TYPE (0) indicates that the packet is alternate routable, and alogical 0 indicates it is not. In this example, normally onlystatistical packets are alternate routable. The only instances that aperiodic packet would be alternate routed are if there was a failure inthe primary route assigned to the destination for the packet or for somereason the packet was assigned a class of service requiring a minimumdelay. Bit position TYPE (1) indicates the type of packet, i.e.,statistical or periodic. That is, if the information words of the packetinclude bursty information, the packet is designated a statisticalpacket, and if the information words of the packet, include circuit typeinformation, e.g., PCM encoded voice or the like, the packet isdesignated a periodic packet. Thus, a logical 1 in bit position TYPE (1)indicates a periodic packet, while a logical 0 indicates a statisticalpacket. Bit positions TYPE (2) and TYPE (3) are employed to select thevalues of thresholds employed in scheduler 113, as described below. Bitposition TYPE (4) indicates whether or not the packet is assigned aminimum delay class of service. Bit positions BKG (0) through BKG (2)are designated the breakage field and indicate the number of bytes inthe last information word M of the packet that do not include userinformation being transmitted and, hence, have been padded. It will beapparent that bit positions BKG (0) through BKG (2) could equally beused to indicate the number of bytes including user information in thelast information word.

BYTE (5) includes bit positions SIZE (0) through SIZE (7) which aredesignated the SIZE field. Bits are placed in the SIZE field whichindicate the number M of information words, i.e., quanta, in thecorresponding packet. That is, bits representative of the packet lengthindicator are placed in the SIZE field. Again, in this example, M can bezero (0) to 255.

BYTE (6) includes six vacant bit positions for a plurality of firstparity check bits which form a first prescribed parity check pattern tobe inserted by parity unit 107 and bit positions SGZ and EXC. The sixvacant bit positions are designated the first parity check field. Bitposition SGZ, in this example, indicates whether or not the packetincludes a number of information words greater than or equal to zero(0). If the packet length is not greater than zero, the packet lengthindicator bits are not needed and information can be transmitted in theSIZE field of BYTE (5) of the transport word. Thus, if only one (1) byteof information is to be transmitted, SGZ is set to a logical 0 and thebyte of information is inserted into the bit positions of the SIZE fieldin BYTE (5), in place of the packet length indicator bits. BYTE (5) isavailable because there is no need in such a packet for a packet lengthindicator because one packet word is assumed. It will be apparent tothose skilled in the art that this technique can be extended to transmittwo or even three bytes of information in the transport word and,therefore, eliminate the need to transmit additional information wordsin this situation. It should also be noted that additional ones of thetransport word fields may be usable to transmit user information. Theuse of the additional fields in the transport word will also increasetransmission efficiency by minimizing the number of information wordsthat need to be transmitted. One example, where additional transportword fields may be used to transport information is a control packet.Bit position EXC in BYTE (6) is used to indicate whether or not thepacket is a control packet.

BYTE (7) includes eight vacant bit positions for a plurality of secondparity check bits forming a second prescribed parity check pattern to beinserted by parity unit 107. The eight vacant bit positions of BYTE (7)are designated the second parity check field.

Input local packet interface 106 supplies the packet information toparity unit 107 on a byte-wise basis. Also supplied to parity unit 107are an ENABLE signal and a start of packet (SOP) signal. The ENABLEsignal indicates a valid byte of information is available and the SOPsignal indicates the beginning of a packet and, hence, the beginning ofa transport word.

Parity unit 107, in each of packetizers 105 generates prescribed paritycheck bits which form a plurality of prescribed parity check patternsthat are inserted into the vacant bit positions of BYTES (6) and (7) ofthe transport word, as indicated in FIG. 4. FIG. 4 also indicates thatreference code word Xref, shown in dashed outline, is employed ingenerating the prescribed parity check bits which form, in this example,the plurality of prescribed parity checks. It will be apparent to thoseskilled in the art, that use of reference code word Xref is notnecessary in practicing certain aspects of the invention. Indeed, eitherEVEN or ODD parity can be used in generating the prescribed parity checkbits. Use of Xref and the number of bits included in Xref is determinedby the number of network layers including private networks in aparticular system. Additionally, it will also be apparent that thenumber of prescribed parity checks and the bit patterns used incomputing the parity check bits used in practicing the invention isdependent on the degree of robustness desired in the system. In thisembodiment of the invention, two prescribed parity checks including 14parity check bits are used to obtain a desired level of robustness. Thatis to say, each bit from the bit positions of BYTE (0) through BYTE (6)of the transport word is used in computing at least two different paritycheck bits.

Accordingly, parity unit 107 is supplied with start of packet signal(SOP), an ENABLE signal and packet information BYTE from input localpacket interface 106. The SOP signal indicates the beginning of thecorresponding packet and, hence, the beginning of the transport word.The ENABLE signal indicates that a valid BYTE of packet information isavailable. In this example, a first prescribed parity check isgenerated, in well known fashion, over the bits in each of verticalcolumns, i.e., groups of bit positions, of BYTE (0) through BYTE (5),and can be either EVEN parity or ODD parity, as desired or as indicatedbelow when using reference code word Xref. That is to say, a separateparity check bit is generated over each of the vertical columns of BYTE(0) through BYTE (5). The first prescribed parity check bits which aregenerated for BYTE (0) through BYTE (5) are PBYT (0) through PBYT (5),respectively, and form the first prescribed parity pattern which isinserted into the first parity check field in BYTE (6) of the transportword, as shown in FIG. 4. It will be apparent that the parity forgenerating the individual parity check bits need not be restricted to abyte but can be computed from bits in any number of bit positions in oneor more bytes, or groups of bit positions. For example, parity can becomputed from bits in specific ones of the functional fields of thetransport word. In this example, a second prescribed parity check isgenerated, in well known fashion, over predetermined ones of the bits ineach of the horizontal rows designated BIT (0) through BIT (7), i.e.,from predetermined similar bit positions in each group of bit positions.The parity generated for each row can also be either EVEN parity or ODDparity, as desired. It is noted that, in this example, a parity checkbit is generated for each of horizontal rows BIT (0) through BIT (7)including the bits in BYTE (0) through BYTE (6). Thus, parity check bitsin bit positions PBYT (0) through PBYT (5) are included in thecomputation of parity check bits forming the second prescribed paritycheck. Again, this increases the robustness of the system so that thelikelihood of a packet information word emulating a transport word isgreatly reduced. Thus, a separate parity check bit is generated for eachof horizontal rows BIT (0) through BIT (7). The second prescribed paritycheck bits which are generated for horizontal rows BIT (0) through BIT(7) are PBIT (0) through PBIT (7), respectively, and form the secondprescribed parity check pattern which is inserted into the second paritycheck field in BYTE (7) of the transport word, as shown in FIG. 4. It isnoted, however, that the parity check bits may be computed from bits inany desired pattern of bit positions in the transport word. Indeed, anydesired number of parity checks may be employed in practicing aspects ofthe invention to realize any desired level of robustness.

As indicated above, the use of reference code word Xref guaranteestransparency for a large number of user networks. Additionally, the useof reference code word Xref causes the probability that a privatenetwork transport word can emulate a public system transport word to bezero. In this example, reference code word Xref includes bits Xref (0)through Xref (11). Xref (0) through Xref (7) are associated withhorizontal rolls of bits designated BIT (0) through BIT (7),respectively, and Xref (8) through Xref (11) are associated with BYTE(0) through BYTE (3), respectively. It should be noted that the numberof bit positions in Xref can be increased or decreased, respectively asdesired. Additionally, the bits of Xref can be applied to any desiredbit positions in the transport word. For example, individual ones of thebits of Xref can be associated with a specific functional field of thetransport word. The parity check bits generated over the bits of BYTE(4) and BYTE (5) can be either EVEN or ODD, as desired. Logical signalsin the bit positions of Xref designate the type of parity generated overthe associated roll of bits and the associated BYTES. In this example, alogical 1 in a bit position of Xref designates EVEN parity, while alogical 0 designates ODD parity. Thus, Xref can be set to any desiredcombination of logical 1's and logical 0's. However, it should be notedthat Xref is the same for a predetermined network or community of nodes.Again, the unique prescribed parity checks are used in conjunction withthe packet length indicator, in accordance with aspects of theinvention, to delimit the packets and effect packet synchronization.Moreover, the use of the unique prescribed parity checks providesverification of the transport word fields. Additionally, as describedbelow, a unique reference code word Xref can be assigned to a specifictransport user to provide a unique identity for its packets and toassure transparency of its packets in the system hierarchy.

Again, each of packetizers 105 generates the packet format as shown inFIG. 2, in a manner which will be apparent to those skilled in the art,by accumulating the number M of information words 202 in the packet andappending the transport word 201 to them. To this end, each of inputlocal packet interfaces 106 stores the information words and inserts theappropriate information concerning the packet into the fields of thetransport word as shown in FIG. 3. This information includes the addressinformation to be placed in the address field including the networkdestination in bit position DEST (0) through DEST (11) (FIG. 3), and thedestination extension (DEST EXT) in bit positions VCID (16) through VCID(19) and the final destination in the remaining VCID bits. The typeinformation is inserted into bit positions TYPE (0) through TYPE (4).The type of packet whether statistical or periodic is usually providedat call set up or otherwise known by the originating packetizer. Thebreakage information is inserted into bit positions BKG (0) through BKG(2) and is readily obtained by knowing the number of bytes ofinformation in the packet being formatted or the number of bytes ofinformation in the last information word of the packet. Similarly, thepacket size information is inserted into bit positions SIZE (0) and SIZE(7). This is readily obtained by knowing the number of information wordsbeing stored for the packet being formatted. The packet size greaterthan zero information is inserted in bit position SGZ. If the packetinformation is in only one byte, a logical zero is inserted in the SGZfield and the byte of information is inserted in the transport word SIZEfield. Again, this information is readily obtained from the number ofbytes of information being stored for the packet being formatted.Finally, information indicating whether or not the packet is a specialpacket is inserted in bit position EXC.

It should be noted that, when there is no information being stored to beformatted into either an information packet or a control packet, inputlocal interface 106 in conjunction with parity unit 107 generates aso-called stuff packet. Stuff packets are generated in the same manneras the information and control packets described above. The differencesbeing that the number of information words in the stuff packet is zeroas indicated by the size field and SGZ, and the destination fieldindicates to scheduler 113 that the stuff packet should be scheduled forstatistics gathering and be directed to statistics port 116. The stuffpacket is comprised of just a transport word.

The packets, whether information, control or stuff are supplied toparity unit 107 on a byte-wise basis along with an ENABLE signal and astart of packet (SOP) signal. Parity unit 107 in response to the ENABLEand SOP signals operates to generate the first and second parity checks,as described above. The generated first parity check bits PBYTE (0)through PBYTE (5) are inserted into the first parity check field and thegenerated second parity check bits PBIT (0) through PBIT (7) areinserted into the second parity check field. The first and second paritychecks are employed in conjunction with the packet length indicator, inaccordance with an aspect of the invention, to delimit the packets andsynchronize the system. As indicated above, parity unit 107 is alsosupplied with reference code word Xref which is employed, in accordancewith an aspect of the invention, to generate the first and second paritychecks which provide a desired level of robustness to thesynchronization process. Additionally, the use of reference code wordXref provides a unique identity for a network and also assures that thenetwork user's packets are transparent in the public system hierarchy.The resulting transport word for the formatted packet is shown in FIG.4.

A specific transport user can employ a packetizer essentially identicalto packetizer 105 to generate packets or employ packet network nodesessentially identical to packet network node 100 in a private network.Then, a unique reference code word Xref is assigned to the specifictransport user to provide a unique network identity. The packetsgenerated with the unique reference code word are assured to betransparent in the public system hierarchy. The broadband packetsgenerated in the private network are identical to the broadband packetsdescribed above. Consequently, the private network packets includingtheir transport words appear as information to packetizer 105 in packetnetwork node 100 and, therefore, are transparent. Packet network node100 simply appends a transport word to the supplied information to formpackets. When the private network packets reach the transport user'sprivate network, the public network transport word is removed and itsunique reference code word Xref is recognized and the private networkpackets are transmitted therein. The packets are supplied on a byte-wisebasis from packetizers 105-1 through 105-Y to input ports 104-(X+1)through 104-(X+Y), respectively. Also supplied from packetizers 105-1through 105-Y are corresponding ENABLE IN signals. The ENABLE IN signalindicates to the corresponding input port that a valid byte of packetinformation is available to be supplied.

It is important to note that the use of the first and second paritychecks, in this example, is powerful enough to verify the data fields inthe transport word. This eliminates the need of an additional separatecheck for the transport word fields as was required in priorarrangements. Additionally, although so-called group processing isadvantageously employed in practicing aspects of the invention, it willbe apparent that other types of processing may be employed.

INPUT PORT

FIG. 5 shows details, in simplified block diagram form, of input ports104. Accordingly, shift bytes unit 501 is supplied an ENABLE IN signal,the reference code word Xref and packet bytes in parallel via BYTE IN.ENABLE IN is at an incoming clock rate and indicates that a valid packetbyte is available for this input port. ENABLE IN is also supplied tobyte counter 502. Shift bytes unit 501 includes a word wide shiftregister, parity generators and a comparator (not shown). In thisexample, a word includes eight (8) bytes in series and each byteincludes eight (8) parallel bits.

Shift bytes unit 501 operates initially to generate the first and secondparity checks, as described above, in relationship to parity unit 107(FIG. 1) in well known fashion, over each eight bytes supplied theretoon a byte-by-byte basis. If a match is obtained between the generatedfirst and second prescribed parity checks, and the expected first andsecond parity patterns in the predetermined fields of the packet word,i.e., PBYT(0) through PBYT(5) and PBIT(0) through PBIT(7), a Tok=1 isgenerated. Outputs from shift bytes unit 501 are the packet word (WORD),the packet length field (SIZE), the packet length greater than zerofield (SGZ), and a transport word candidate indicator (Tok). Shift bytesunit 501 supplies as outputs SIZE, SGZ and Tok which, in turn, aresupplied to control 506. The packet WORD is supplied to word latch 503where it is stored until write time slot 0 occurs in the polling cycleof packet cross connect 103, at which time RAM 504 is enabled to writethe WORD. Appropriate fields of the packet WORD are also written intoscheduler data store 505 if it is a transport word candidate asindicated by Tword=1. The packet WORD is written into a memory locationin RAM 504 identified by an address generated by RAM address generator509. RAM address generator 509 is responsive to a word complete (WC)signal from byte counter 502 to advance a write address counter duringthe write time slot. RAM address generator 509 is also operative to passaddress signals from address bus ABUS to read a packet WORD from RAM 504which is supplied to databus DBUS and, consequently, to the one ofoutput ports 110 (FIG. 1) requesting the corresponding WORD. It is notedthat anyone of output ports 110 can read a word from any given inputport 104 during a polling cycle. In this example, RAM 504 has thecapability of storing 4K words.

Byte counter 502 is responsive to ENABLE IN for counting the number ofpacket bytes supplied to input port 104. A word complete output (WC)from byte counter 502 indicates that a packet word, in this example, 8bytes, is complete and is supplied to word counter 507, word latch 503,scheduler data store 505, status latch 508 and RAM address generator509.

In response to the word complete (WC) signal, word latch 503 latches theWORD from shift bytes unit 503; status latch 508 latches the WORD COUNTfrom word counter 507, Tword from control 506 and lpkTok from control506; RAM address generator 509 is enabled to be advanced by one address;and scheduler data store 505 is enabled to input data. It is noted thata WC signal is also generated when byte counter 502 is reset.

Word counter 507 is responsive to the WC output from byte counter 502 tocount the number of packet words supplied to input port 104. The countof packet words (WORD COUNT) is supplied to status latch 508 and tocontrol 506.

Scheduler interface 510 interfaces input port 104 to TBUS.

Control 506 is responsive to the supplied SIZE field, SGZ field, Tok andWORD COUNT for controlling input port 104 to synchronize on the incomingpackets. To this end, control 506 generates a signal Tword, whichindicates whether or not the packet word is a possible transport wordcandidate and a signal lpkTok which indicates whether or not the lastpacket transport word was valid, i.e., ok. Tword and lpkTok are suppliedto status latch 508.

Operation of control 506 in obtaining frame synchronization of inputport 104 for incoming packets can be explained by referring to the flowchart shown in FIG. 6. Accordingly, the control routine is entered viaenter step 601. Thereafter, operational block 602 initializes bytecounter 502 and word counter 507 by resetting them and the stored packetSIZE is set to zero (0) packet words, i.e., M=0. Input port 104 isdefined to be in an OUT-OF-FRAME mode. Operational block 603 indicatesthat a packet byte has been supplied to shift bytes unit 501. Asindicated above, shift bytes unit 501 generates the predetermined firstand second parity check bits and compares them to the first and secondparity check bits in the predetermined fields of the packet word,namely, PBYTE(0) through PBYTE(5) in BYTE(6) and PBIT(0) through PBIT(7)in BYTE(7) (FIG. 4). If a match is obtained a Tok=1 is generated.Otherwise, a Tok=0 is generated. Conditional branch point 604 tests todetermine whether or not the WORD COUNT in word counter 507 is equal tothe number of packet words indicated by SIZE plus one (1), i.e., M+1. Inthe initial pass of the process, step 604 yields a YES result after thefirst word has been supplied to shift bytes unit 501(FIG. 5). Onsubsequent passes, the packet length indicator value M is obtained fromthe expected SIZE field and the SGZ field in the packet word, namely,BYTE(5) and the SGZ bit position in BYTE(6). If the test result in step604 is NO, conditional branch point 605 tests to determine if Tok=1. Ifthe test result in step 605 is NO, control is returned to operationalblock 603. Thereafter, steps 603, 604 and 605 are iterated until eitherstep 604 yields a YES result or step 605 yields a YES result. If step604 yields a YES result, conditional branch point 606 tests to determineif Tok=1. If the test in step 606 is NO, operational block 607 setsTword=1, and lpkTok=0, resets byte counter 502 and word counter 507, andcauses the expected number of information words (M) in the packet fromthe SIZE field to be stored. Signal lpkTok indicates whether or not thelast packet transport word candidate is valid or not. Accordingly,lpkTok=0 indicates that the last packet transport word candidate is notvalid and lpkTok=1 indicates that it is valid. Resetting of byte counter502 generates a WC signal. Consequently, the current WORD from shiftbytes unit 501 is latched in word latch 503; the WORD COUNT from wordcounter 507, Tword from control 506 and lpkTok from control 506 arelatched in status latch 508; RAM address generator 509 is enabled to beadvanced an address; and scheduler data store 505 is enabled to storedata. Upon write time slot 0 occurring in the synchronous polling cycleof packet cross connect 103, the address in RAM address generator 509 isadvanced and the packet WORD from word latch 503 is written into thememory location of RAM 504 identified by RAM address generator 509.Similarly, upon the write time slot occurring in the polling cycle ofpacket cross-connect 103 and Tword=1 from status latch 508, the DEST,DEST EXT, and TYPE fields from the packet WORD stored in word latch 503are written into scheduler data store 505. Additionally, thecorresponding address designating the packet starting address (SAD) fromRAM address generator 509 for the packet word is also written intoscheduler data store 505. Thereafter, appropriate ones of steps 603through 607 are iterated until either step 605 or step 606 yields a YESresult. either of these YES results indicates that a possible transportword candidate has been identified and a so-called ALMOST IN-FRAME modeof operation is entered. To this end, operational block 608 sets Tword=1and lpkTok=0, resets byte counter 502 and word counter 507, and causesthe number of information words M from the SIZE field to be stored.Again, the resetting of counter 502 causes generation of a WC signalwhich, in turn, causes the actions to occur as set forth above in step607. Operational block 609 indicates that another packet byte has beensuppled to shift bytes unit 501. Then, conditional branch point 610tests to determine if the WORD COUNT in word counter 507 equals SIZE+1.SIZE+1 is the total length of the packet and points to the expected nextpacket transport word. If the test result in step 610 is NO, conditionalbranch point 611 tests to determine if Tok=1. If the test result in step611 is NO, the current packet WORD in shift bytes unit 501 is not avalid transport word candidate and steps 609 through 611 are repeateduntil either step 610 or step 611 yields a YES result. If step 610yields a YES result, conditional branch point 612 tests to determine ifTok=1. If the test result in step 612 is NO, the packet WORD presentlyin word latch 503 is not a valid transport word candidate. Control isreturned to step 607 and appropriate ones of steps 603 through 612 areiterated. If step 611 yields a YES result, the current packet WORD inword latch 503 is not a valid transport word and steps 608 through 611are iterated until step 610 yields a YES result and step 612 is reached.A NO result in step 612 again indicates that the present packet WORDbeing pointed to by the previous packet length indicator is not a validtransport word and the reframing process is reinitiated by returningcontrol to step 607. When step 612 yields a YES result, the WORD latchedin word latch 503 is a valid transport word and input port 104 is insynchronism with the incoming broadband packets. An IN-FRAME mode ofoperation has been entered.

To summarize, steps 603 through 607 operate on the incoming packet on abyte-by-byte basis to identify a first transport word candidate. Thensteps 608 through 612 operate on the incoming packet also on abyte-by-byte basis to identify a subsequent transport word candidatepointed to by the packet length indicator from the previous transportword candidate. Upon detection of the subsequent transport wordcandidate pointed to by the packet length indicator from the previoustransport word candidate, the previous transport word candidate isidentified as a valid transport word, in accordance with an aspect ofthe invention.

Once a valid transport word has been identified, operation of input port104 enters an IN-FRAME mode. In the IN-FRAME mode, testing for transportword candidates, in this example, is done on a word wise basis. To thisend, operational block 613 sets Tword=1 and lpkTok=1, resets bytecounter 502 and word counter 507 and causes the number of informationwords in the packet from the SIZE field to be stored. This indicatesthat a GOOD transport word and, hence, a GOOD packet has beenidentified. That is to say, the last packet received has been identifiedas a GOOD packet. Thereafter, operational block 614 indicates that apacket word has been supplied to shift bytes unit 501. Then, conditionalbranch point 615 tests to determine if the WORD COUNT in word counter507 equals SIZE+1. If the test result in step 615 is NO, steps 613 and614 are repeated until a YES result in step 615 is obtained. Thereafter,conditional branch point 616 tests if Tok=1. If the test result in step616 is YES, another GOOD packet has again been identified. Again, theWORD COUNT from word counter 507, and Tword and lpkTok signals fromcontrol 506 are written into status latch 508 in response to a wordcomplete (WC) signal. In turn, the stored WORD COUNT and lpkTok signalare written into scheduler interface 510 during the write time slot ofthe polling cycle of cross-connect 103. When lpkTok=1 the packettransport data stored in scheduler data store 505 for the last previouspacket and lpkTok are supplied via scheduler interface 510 to crossconnect 103 transport bus TBUS for use by scheduler 113. That is, thepacket transport information fields DEST, DEST EXT, WORD COUNT and TYPE,the packet starting address (SAD) and the last packet status lpkTok aresupplied to TBUS. The packet source (SCR), i.e., input port, is known toscheduler 113 by the time slot in the polling cycle during which thetransport information was supplied to TBUS. If the test result in step616 is NO, the operation of input port 104 re-enters the OUT-OF-FRAMEmode, control is returned to step 607 and the reframing process isreinitiated.

STUFF PORT

Stuff port 109 generates so-called stuff packets which are stored inbuffer memory for use by output ports 110-1 through 110-(X+Y) when noother packets are available for transmission. The stuff packets eachcomprise only a transport word which is generated in identical manner asdescribed above regarding packetizers 105. The DEST field, however,includes a predetermined destination which indicates that the packet isa stuff packet and eventually will be used to determine facilityactivity. To this end, stuff port 109 interfaces with address bus ABUSand data bus DBUS.

OUTPUT PORT

FIG. 7 shows details, in simplified block diagram form, of each ofoutput ports 110. As indicated above, each of output ports 110interfaces with cross-connect 103 address bus ABUS, scheduler bus SBUS,data bus DBUS and total quanta bus TQBUS. As explained below, scheduler113 supplies packet output information via SBUS concerning packets to betransmitted by output ports 110. This information includes the outputport identity, the input port identity (SRC), the starting address (SAD)of the packet being stored in the corresponding input port, WORD COUNT(total length) of the packet and the TYPE of packet, i.e., periodic orstatistical. Output port 110 operates on this information, in accordancewith aspects of the invention, to schedule transmitting of statisticalpackets and to reserve intervals for transmitting periodic packets.

The packet output information is obtained from SBUS at the appropriateone of output ports 110 by queue controller (QCON) 701. QCON 701determines from TYPE whether the packet is a periodic packet or astatistical packet. If it is a periodic packet, the input port identity(SRC), packet starting address (SAD) and total length, i.e., WORD COUNT(M+1) in packet word intervals, of the packet are stored in periodicqueue 702, REAL QSUM counter 703 is incremented by the WORD COUNT andRESERVED QSUM counter 704 is decremented by the WORD COUNT. It is notedthat the value RESQSUM in RESERVE QSUM counter 704 cannot be less thanzero (0). RESQSUM is supplied to adder 709 and TQBUS. If the packet isstatistical, the input port identification (SRC), packet startingaddress (SAD) and the WORD COUNT for the packet are stored instatistical queue 705; REAL QSUM counter 703 is incremented by the WORDCOUNT; and RESERVE QSUM counter 704 is incremented by a valuerepresentative of a reserved interval (RI), namely, RI=(k/1-k)(M+1), ofpacket words.

Reservation factor k, in this example, is representative of thepercentage of periodic packets expected to be transmitted from acorresponding output port. The value of reservation factor k can be apredetermined fixed value, a value supplied by a processor based on callset-up or calculated dynamically by reservation factor calculator 716.Reservation factor calculator 716 is responsive to the word completesignal WC and the number of periodic, i.e., Type 1, packet words beingtransmitted by output port 110 during a predetermined interval togenerate the value of reservation factor k. Details of reservationfactor calculator 716 are shown in FIG. 10 and described below.

Both periodic queue 702 and statistical queue 705 are, in this example,first in first out (FIFO) registers and interface with next packet unit706. REAL QSUM counter 703 is decremented by one packet word in responseto a word complete (WC) signal from byte counter 707. This followsbecause a packet word has been transmitted. Time unit 708 generates arefence time T, which is arbitrary time, e.g., now. Time unit 708 isalso incremented by a packet word interval in response to the WC signal.Since in this packet network node, packets are continuous and contiguousin the byte intervals designated by ENABLE, this is a smooth process.

Adder 709 combines the REAL QSUM and RESQSUM to obtain TQSUM, namely,

    TQSUM=REAL QSUM+RESQSUM,                                   (1)

where the individual values are in packet word intervals and TQSUM isrepresentative of the queuing delay in the output port. In turn, TQSUMis supplied to adder 710 and TQBUS. Adder 710 is enabled in response toarriving statistical packets at statistical queue 705 to combine TQSUMand time T to obtain the scheduled time of service value STOS for eachcorresponding statistical packet, namely,

    STOS=TQSUM+T.                                              (2)

This operation will become more apparent from the discussion of FIGS. 8and 9 below.

The STOS values for the arriving statistical packets are stored inscheduled time of service (STOS) queue 711 which, in this example, isalso a FIFO register. The next scheduled time of service (NSTOS) at thetop of the FIFO in STOS queue 711 is supplied to next packet unit 706.Also supplied to next packet unit is time T and a packet complete (PC)signal from word counter 712. Next packet unit 706 operates to supplythe starting address (SAR) and the input port identity (SRC) of thepacket to be transmitted to address counter 713 and the total packetlength M+1 as indicated by WORD COUNT to word counter 712. If the nextpacket to be transmitted is a statistical packet, supplying of thisinformation is delayed at least until the scheduled time of service(STOS) occurs or, thereafter, until transmission of a periodic or stuffpacket has been completed. If there is no information regarding periodicpackets to be transmitted in periodic queue 702 and the next scheduledtime of service (NSTOS) for a statistical packet has not occurred stuffpackets are requested by supplying the address of a stuff packet instuff port 109 to address counter 713. Next packet unit 706 supplies asan output a logical 1 STUFF signal when a stuff packet is beingtransmitted. The STUFF signal is supplied to a corresponding one ofoutput local packet interfaces 112 (FIG. 1), to REAL QSUM counter 703and RESERVE QSUM counter 704. It is noted that the STUFF signal is notrequired to be supplied to output facility interfaces 111. REAL QSUMcounter 703 is responsive to the logical 1 STUFF signal to inhibit itsdecrement input (-) so that the REAL QSUM is not decremented in responseto a word complete signal WC. This follows because the REAL QSUM countwas not incremented in response to the stuff packet request. The STUFFsignal is also supplied to the decrement input of RESERVE QSUM counter704 and the RESQSUM count is decremented by one packet word in responseto the logical 1 STUFF signal. Address counter 713 supplies the addressof the requested packet word to address bus ABUS and, in turn, theidentified word in the corresponding one of input ports 104 RAM memoryor stuff port 109 is read to data bus DBUS and supplied to word latch714. Byte converter 715 supplies the packet words a byte at a time inresponse to ENABLE OUT from a corresponding output interface. ENABLE OUTis also supplied to byte counter 707 which generates a word complete(WC) signal when the appropriate number of bytes have been transmitted.In this example, a packet word includes eight bytes in series and eachbyte includes eight bits in parallel. The WC signal is also supplied toword counter 712, address counter 713, word latch 714, byte converter715 and reservation factor calculator 716. Word counter 712 isresponsive to WC and the total length of the packet, i.e., WORD COUNT,to generate a packet complete (PC) signal when the number of packetwords transmitted equals WORD COUNT. Packet complete signal PC issupplied to next packet unit 706 to initiate transmission of the nextpacket. Word counter 712 also supplies a first packet word signal tobyte counter 707 which, in response thereto, generates a start of packet(SOP) signal. Address counter 713 is responsive to the WC signal toadvance the address by one word and, hence, identify the memory locationin the appropriate input port RAM storing the next packet word to besupplied via DBUS to word latch 714. The STUFF and SOP signals aresupplied to a corresponding one of output local packet interfaces 112-1through 112-Y. The STUFF and SOP signals are not supplied to outputfacility inte faces 111-1 through 111-X because they are not needed. Itis noted that, through this process, in accordance with an aspect of theinvention, any one of output ports 110 can address any packet in any oneof the RAM memories of input ports 104 during the synchronous pollingcycle. Additionally, this feature allows a so-called broadcast mode ofoperation in cross-connect 103. That is to say, any number of outputports 110 can address the same packet in a particular one of input ports104 during a polling cycle and, hence, simultaneously supply that samepacket as an output. Consequently, any problems of prior packettransmission and/or switching arrangements caused by so-called head ofthe line blockage is eliminated. This results in greater throughput incross-connect 103 and, hence, in any network in which it is employed.Output port status unit 717 provides a status indication, i.e., whetherthe output port is functioning properly or not, to processor 114 of FIG.1.

Operation of output port 110, in accordance with aspects of theinvention, can best be explained by way of examples. Accordingly, FIG. 8shows a sequence of timing diagrams (a) through (e) illustratingoperation of output port 110 for arriving statistical, periodic andstuff packets. Thus, FIG. 8 (a) shows arrival times for statisticalpackets S1, S2, S3, S4 and S5 and for periodic packets P1, P2, P3, P4and P5. The arrival of the stuff packets is not shown because they donot directly affect the calculation of the scheduled time of service forthe statistical packets. It is assumed that upon arrival of statisticalpacket S1, that transmission has just been completed for either aperiodic or stuff packet, and there are no other packets to betransmitted and there is no reserved interval for transmitting periodicpackets. Consequently, statistical packet S1 is scheduled for serviceimmediately. This follows from equation (2) since the REAL QSUM is zero(0) and the RESQSUM is zero (0) and, consequently, TQSUM is zero (0).Therefore, the scheduled time of service for packet S1 is time T or now,as shown in FIG. 8(b). The REAL QSUM counter 703 is incremented by theWORD COUNT of S1 labeled S1, and the RESERVE QSUM counter 704 isincremented by (k/1-k)(M+1) of S1 designated (k/1-k)S1, as shown in FIG.8(c). Upon statistical packet S2 arriving, TQSUM is the value of REALQSUM, i.e., the total length of packet S1 less the number of packetwords which have been transmitted, plus RESQSUM, i.e., (k/1-k) S1.Therefore, from equation (2) STOS for packet S2 is T+TQSUM. T is thetime at which S2 arrived, and the REAL QSUM and, hence, TQSUM has beendecremented by the number of packet words which have been transmittedfor packet S1, as shown in FIG. 8(b). REAL QSUM counter 703 isincremented by the WORD COUNT for S2 designated S2, and the RESERVE QSUMcounter 704 is incremented by (k/1-k)(M+1) for packet S2, designated(k/1-k)S2, also as shown in FIG. 8(b). This procedure is followed forstatistical packet S3. When periodic packet P1 arrives, REAL QSUMcounter 703 is incremented by the WORD COUNT for P1 and the RESERVE QSUMcounter 704 is decremented by the total length of P1. This followsbecause an interval, i.e., time, has been reserved, in accordance withan aspect of the invention, for the transmission of periodic packets andnormally the net change in TQSUM should be zero (0) regarding schedulinga time of service for subsequently arriving statistical packets. It isnoted, however, that when RESQSUM is zero (0), i.e., no time is reservedfor transmission of periodic packets and there are no statisticalpackets to be transmitted, the total length of the periodic packet orpackets determines, in part, the calculated scheduled time of servicefor any arriving statistical packets, see equations (1) and (2). Whenstatistical packets S4 and S5 arrive, each respective scheduled time ofservice (STOS) is determined as set forth above. The periodic packetsP2, P3, P4 and P5 are placed in the periodic queue as they arrive, andthe appropriate incrementing of REAL QSUM counter 703 and thedecrementing of RESERVE QSUM counter 704 are effected.

The actual service times for the packets are shown in FIG. 8(d), and theactual times of service and departure of the packets are shown in FIG.8(e). As indicated above, statistical packet S1 was scheduled forservice immediately upon its arrival and an interval based on thepredetermined relationship to the total length of the statistical packethad been reserved, in accordance with an aspect of the invention, toservice periodic packets. Thus, periodic packet P1 presently in theperiodic queue is serviced upon completing the transmission ofstatistical packet S1. Since the transmission of periodic packet P1 iscompleted prior to the occurrence of the STOS for the next statisticalpacket S2, and there are no other periodic packets presently in theperiodic queue, one or more stuff packets (SP) are transmitted. This isimportant so that synchronization is maintained in the network and sothat information flow is smooth. As noted above, continuedsynchronization requires that there are continuous and contiguouspackets in the network. If there was another periodic packet in theperiodic queue it would have been serviced immediately. However, sinceperiodic packet P2 arrives prior to the STOS for statistical packet S2(FIG. 8(b)), it will be serviced upon completing the transmission of thecurrent stuff packet. Since the stuff packets are only one packet wordin total length, the delay in servicing packet P2 is at most only onepacket word interval. Since the total length of periodic packet P2 isgreater than the remainder of reserved interval (k/1-k)S1, the actualtime of service of statistical packet S2 is delayed until transmissionof periodic packet P2 is completed, as shown in FIG. 8(d) and (e). Uponcompletion of transmission of packet S2, periodic packet P3 is serviced.Again, since the transmission of periodic packet P3 is completed beforethe STOS has occurred for statistical packet S3, stuff packets aretransmitted until the STOS for packet S3 occurs. Upon completing thetransmission of statistical packet S3, periodic packet P4 is serviced.Since the transmission of periodic packet P4 is completed prior to theoccurrence of STOS for statistical S4, and periodic packet P5 is in theperiodic queue, it will be serviced immediately upon completing thetransmission of periodic packet P4. Service of statistical packet S4 isdelayed until the transmission of periodic packet P5 is completed. Then,statistical packet S4 is transmitted. Thereafter, stuff packets aretransmitted until the occurrence of STOS for statistical packet S5 atwhich time it is transmitted. Thereafter, stuff packets are transmitteduntil additional statistical packets and/or periodic packets havearrived at the output port. By employing this unique multi-queue outputscheduling arrangement, in accordance with aspects of the invention,statistical packets are serviced without undue delay. Indeed, thelongest interval that a statistical packet can be delayed from itsscheduled time of service is an interval equal to that required for thetransmission of a maximum length periodic packet which, in this example,is 256 packet words. By employing this unique multi-queue strategy, inaccordance with an aspect of the invention, delaying of periodic packetsis minimized, obtaining accurate information for scheduler 113 regardingdelays encountered by statistical packets is realized and smoothing isachieved of bursty statistical packets streams.

FIG. 9 shows another sequence of timing diagrams (a) through (e)illustrating operation of output port 110 for another sequence ofarriving statistical and periodic packets. FIG. 9(a) again shows arrivaltimes for statistical packets S1, S2, S3, S4 and S5 and periodic packetsP1, P2 and P3. It is again assumed that initially the periodic orstatistical queues are empty and that there is no reserved interval fortransmission of periodic packets. Consequently, from equations (1) and(2) it is seen that statistical packet S1 is serviced immediately, asdescribed above regarding FIG. 8. The remaining statistical packets S2through S5 are scheduled for service in the manner as described above inrelationship to FIG. 8 and their respective STOS's are shown in FIG.9(b). The corresponding calculated time of service showing intervalsreserved for transmission of periodic and/or stuff packets is shown inFIG. 9(c). Again, the intervals shown in FIG. 9(c) are generated asdescribed above in relation to FIG. 8. The actual times of service forthe packets and departure of the packets is shown in FIGS. 9(d) and (e).Thus, as shown in this example, statistical packet S1 is firsttransmitted in a manner as described above regarding FIG. 8. Uponcompleting the transmission of packet S1, periodic packet P1 istransmitted, in a manner as described above regarding FIG. 8. Sinceperiodic packet P2 is in the periodic queue and the STOS for statisticalpacket S2 has not occurred, it is serviced upon completing transmissionof periodic packet P1. However, as shown in FIG. 9(d), periodic packetP2 is large and exceeds all the reserved intervals RESQSUM for periodicpackets in RESERVE QSUM counter 704. Consequently, upon completing thetransmission of periodic packet P2, statistical packets S2 through S5are consecutively transmitted. The statistical packets are transmittedin the manner shown in FIG. 9(d) because their corresponding STOS haspassed. There is no reserved interval RESQSUM for the transmission ofperiodic or stuff packets. The time at which each of the statisticalpackets is to be transmitted is determined in next packet unit 706 inresponse to time T and NSTOS. Specifically, if the STOS for the nextstatistical packet has passed, the corresponding statistical packet istransmitted upon completing the transmission of periodic packet P2.Thus, in this example, and from FIG. 9, it is seen that the STOS's forstatistical packets S2 through S3 have passed prior to completing thetransmission of periodic packet P2 and that the STOS for statisticalpacket S4 has passed prior to completing the transmission of packet S3.Consequently, packet S4 is transmitted upon completing the transmissionof packet S3. Similarly, the STOS for statistical packet S5 passes priorto completing transmission of statistical packet S4 and, therefore,statistical packet S5 is transmitted immediately upon completing thetransmission of statistical packet S4. Periodic packet P3 is nottransmitted until there is a reserved interval RESQSUM in RESERVE QSUMcounter 704, or there are no statistical packets to be transmitted.Thus, the transmission of periodic packet P3 is initiated uponcompleting the transmission of statistical packet S5. In this manner,statistical packets are assured to be transmitted within a reasonabledelay interval. Again, it is noted, that transmission of a statisticalpacket will be delayed, at most, for an interval required to transmit amaximum length periodic packet. However, in this example, thestatistical and periodic packets may encounter unexpected delayintervals and, consequently, the desired smoothing is not realized. Thisunderscores the improtance of accurately estimating the value ofreservation factor k, i.e., the percentage of the available bandwidthallocated for transmission of periodic packets.

FIG. 10 shows details, in simplified blcok diagram form, of reservationfactor calculator 716 (FIG. 7). Accordingly, word complete signal WC issupplied to word counter 1001. Word counter 1001 generates an outputpulse I after a predetermined number of packet words have been countedwhich denotes a predetermined interval. Type 1 counter 1002 is reset bythe output pulse I from word counter 1001 and is incremented by signalTYPE 1 to yield a count of the number of type 1 packet words, i.e.,periodic packet words, which have been transmitted during thepredetermined interval. Output pulse I also enables exponentially mappedpast (EMP) average generator 1004 to update its output value k', whichis representative of a smooth average of the number of periodic packetstransmitted during the predetermined interval. Similarly, output pulse Ienables comparator 1003 to compare the new EMP average k' to the presentreservation factor k and, if there is a difference, to adjust up-downcounter 1005 accordingly. The output from up-down counter 1005 is thereservation factor k. EMP average generator 1004 generates anexponentially mapped past average k' of TYPE 1 packets which have beentransmitted in the last I packet words in accordance with:

    k'=W.sup.j +(1-W).sup.k,                                   (3)

where j is a value representative of the proportion of periodic packetswhich have been transmitted at the output port during the predeterminedinterval TI, i.e., the interval needed to transmit I packet words, k isthe reservation factor and is a value representative of the proportionof periodic packets expected to be transmitted from the output port andW is a weighting factor having a value between zero(0) and one(1). Thevalues of the predetermined interval TI in packet words and weightingfactor W are dependent on the packet transmission rate and the desiredaveraging time constant, namely τ=TI/W.

FIGS. 11, 12, 13, 14, and 15 when connected A--A, B--B, C--C, D--D,E--E, F--F, G--G, H--H, I--I, J--J, K--K, and L--L form a flow diagramillustrating operations performed by scheduler 113 (FIG. 1). To thisend, scheduler 113 interfaces with processor 114, TBUS, TQBUS and SBUS.TBUS supplies packet transport information from input ports 104-1through 104-(X+Y) to scheduler 113 on a synchronous basis. In thisexample, the synchronous timing sequence, i.e., input port pollingcycle, includes N+1 time slots and has a timing rate such that eachpolling cycle is completed in less than a packet word interval ofpackets being supplied at the maximum packet transmission rate for thepacket network node. It is again noted that X+Y=N and that time slot 0is used to write certain information into units of input ports 104. Thepacket transport information obtained by scheduler 113 from TBUS is thepacket destination (DEST), the packet destination extension (DEST EXT),the WORD COUNT for the packet, the last packet transport wordOK(lpkTok), type of packet (TYPE) and starting address (SAD) in the RAMof the corresponding input port. The source (SCR), i.e., input port, ofthe transport information is known by the time slot of the polling cycleduring which the transport information was supplied to TBUS from thecorresponding input port. Processor 114 provides information as to thestatus of the input and output ports and the delay difference (DD)between the primary route and secondary route assigned to each for thepacket destination (DEST). Port status is obtainable in well knownfashion by, for example, transmitting test packets or simply observingwhether or not "good" packets are being received. This information isobtained, in part, from statistics port 116. The delay differences arereadily obtained by making delay measurements. The measurements may beobtained by employing so-called loop messages to measure the round tripdelay on routes between packet network nodes.

Scheduler 113 also includes a so-called routing memory (RAM) whichstores information regarding possible routes for the packet, i.e.,primary or secondary, assigned to the packet destination. The routingRAM also includes the delay difference value between the primary andsecondary routes. Also stored in the routing RAM is informationindicating if the packet has previously been alternate routed, i.e., aso-called rerouted status. For certain control packets the alternaterouted field is employed to indicate status of certain of the inputports. It is noted that the primary output port assigned to the packetdesignation may be a so-called "real" output port or a so-called"logical" output port. In this example, there are N=8 real output portswhich are designated 1-8. The so-called logical output ports aredesignated 0 and 9-15 and are, in this example, as follows: 0-stuff,9-not assigned, 10-conditional source (CSRC), 11-conditional extension(CEXT), 12-destination extension (DEST EXT), 13-control (CTL), 14-notassigned and 15-stuff. Thus, if a primary output port is identified as1-through 8 it is a "real" output port, i.e., an actual one of outputports 110 in this node to which traffic is being directed and if it isidentified as, for example, 13 it is the one of output ports 110assigned to control. The routing RAM is indexed by the DEST field of thepacket to yield the stored information.

Additionally, scheduler 113 includes a so-called threshold memory unit(RAM) (not shown) which stores information regarding possible thresholdvalues employed in determining the routes of the packets. Specifically,the threshold RAM stores threshold values for queuing delay TD,alternate routing delay TA and re-routing delay TRR. The threshold RAMis indexed by the TYPE field, as indicated above, to selectpredetermined threshold values TD, TA, and TRR for the particularpacket. In this example, the selection of the threshold values is basedon the type of packet, grade of service assigned to the packet andso-called droppability of the packet.

Accordingly, the process of scheduler 113 is entered via start oval1101. Thereafter, operational block 1102 sets the one of input ports 104to be polled to one (1). Then, conditional branch point 1103 tests todetermine if the status is good for the particular one of input ports104-1 through 104-(X+Y) being polled. If the test result in step 1103 isNO, the port is not good, i.e., not functioning properly, andoperational block 1104 causes the packet output information to besupplied to statistics port 116. This is achieved by operational block1105 writing the appropriate packet output information on SBUSidentifying statistics port 116 as the output port. The packet outputinformation written on SBUS typically includes the output port address,the source of the packet (SRC), the starting address of the packet inRAM of the corresponding input port identified by SRC, the TYPE fieldand WORD COUNT which is the total length (M+1) of the packet.Thereafter, conditional branch point 1106 tests to determine if inputport 104-(X+Y) has been polled. If the test result in step 1107 is NO,operational block 1106 causes the input port to be polled next to be setto the next one, i.e., input port=input port+1. Then, control isreturned to step 1103. If the test result in step 1106 is YES, the lastinput port X+Y=N in the polling cycle has been serviced and operationalblock 1108 causes the polling sequence to wait one (1) time slot. Asindicated above, this is time slot 0 in the polling cycle which isemployed to write information into several units in each of input ports104. Thereafter, control is returned to step 1102. Returning to step1103, if the test result is YES, the input port being polled is good andconditional branch point 1109 tests to determine if the packet beingserviced in the particular one of input ports 104 is a new packet. Ifthe test result in step 1108 is NO, control is returned to step 1106 andappropriate ones of steps 1102 through 1109 are iterated until step 1109yields a YES result. Then, operational block 1110 causes the new packettransport information to be obtained from TBUS. Again, it is noted thatthe routing RAM is indexed by the DEST field to yield the storedinformation regarding the primary and secondary routes and, hence, theprimary and secondary output ports assigned to the packet destination,the delay difference between the routes and the rerouting status or ifthe output port is a logical output port an indication of appropriateones of input ports 104 designated for a particular control function.Similarly, the threshold RAM is indexed by the TYPE field to yieldvalues for thresholds TD, TA and TRR. Thereafter, conditional branchpoint 1111 tests to determine if the packet is good or if it is a stuffpacket. If lpkTok=1, the packet is good. If the primary output port forthe packet is identified as 0 or 15 from the routing RAM the packet is astuff packet. If the test result in step 1111 is NO, the packet iseither not good, i.e., lpkTok=0, or a stuff packet and operational block1104 causes the appropriate packet output information to be supplied tostatistics port 116 via step 1105 and SBUS. Thereafter, control isreturned to step 1106 and appropriate ones of steps 1102 through 1111are repeated until step 1111 yields a YES result. If the test result instep 1111 is YES, the packet is good and operational block 1112 obtainsthe primary and secondary routes assigned to the packet destination(DEST), the delay difference (DD) between the primary and secondaryroutes, threshold values TD, TA and TRR and re-routing status for thepacket, i.e., whether the packet was previously alternate routed or not.It is noted that typically the primary route has less fixed transmissiondelay than the secondary route, however, there may be instances that thedelays are substantially equal. Operational block 1113 obtains fromTQBUS the queuing delay at the ones of output ports 110 assigned to theprimary and secondary routes, namely, TQSUM(P) and TQSUM(S),respectively, and the interval reserved for the transmission of periodicpackets, namely, RESQSUM(P) and RESQSUM(S), respectively. The status,i.e., good or bad, for the primary and secondary output ports, namely,status (P) and status (S), respectively, assigned to the packetdestination is obtained from processor 114.

Conditional branch point 1114 tests to determine if the primary outputport for the packet is the one of output ports 110 designated thecontrol port. This is obtained from the routing RAM. Specifically, inthis example, if the primary output port is designated 13, it is thedesignated control output port. If the test result in step 1114 is YES,conditional branch point 1115 (FIG. 13) tests to determine whether thestatus of the output port designated control (CTL) is good. If the testresult in step 1115 is NO, control is returned to step 1104 andappropriate ones of the steps of the process are repeated until eitherstep 1114 yields a NO result or step 1115 yields a YES result. If step1115 yields a YES result, conditional branch point 1116 tests todetermine if the queuing delay, i.e., number of packet words waiting tobe transmitted, at the control output port exceeds a predeterminedthreshold value, namely, whether

    TQSUM(CTL)>TD,                                             (4)

where the value TD is set so that if the packet is going to experiencemore than an acceptable value of queuing delay, its transmission isterminated at statistics port 116. For example, the value of thresholdTD is set such that if the packet will be overwritten in the RAM in thecorresponding one of input ports 104 prior to being transmitted from theassigned output port the packet transmission is essentially terminated.Thus, if the test result in step 1116 is YES, control is returned tostep 1104 and the statistics port is designated the output port. Step1105 (FIG. 15) causes the appropriate packet output information to bewritten to SBUS which, in turn, supplies it to statistics port 116.Thereafter, control is returned to step 1106 (FIG. 11). If the testresult in step 1116 is NO, operational block 1117 designates the outputport to be the one of output ports 110 assigned to be the control (CTL)output port. Step 1105 causes appropriate packet output information tobe supplied to the control output port via SBUS. Thereafter, control isreturned to step 1106 and appropriate steps of the process are iterated.

Returning to step 1114 (FIG. 12), if the test result is NO, the primaryoutput port is not control and conditional branch point 1118 tests todetermine if the primary output port is identified as the output portassigned to the source (SRC) of the packet, namely, the conditionalsource (CSRC). This designation essentially loops the packet back to itssource. To this end, conditional branch point 1119 tests to determine ifthe conditional source (CSRC) is intended to have this packet routed toit. This is realized by evaluating the routing status field to determineif the input port (SRC) which supplied the packet is approved for thisfunction. If the test result in step 1119 is NO, appropriate ones ofsteps 1115-1117 are repeated to determine if the output port is thecontrol output port or the statistics output port. If the test result instep 1119 is YES, conditional branch point 1120 tests to determine thestatus of the output port OPSRC assigned to the particular input port(SRC). If the test result in step 1120 is YES, the status (OPSRC) isgood and conditional branch point tests to determine if the queuingdelay at the output port (OPSRC) exceeds a predetermined threshold,namely, whether

    TQSUM(OPSRC)>TD.                                           (5)

The value of and conditions set for threshold TD are essentially thesame as that used in equation (4). If the test result in step 1121 isYES, the queuing delay is too long and step 1104 (FIG. 11) causes theoutput port to be statistics port 116. Step 1105 causes the appropriatepacket output information to be written on SBUS which, in turn, suppliesit to statistics port 116. The packet output information written on SBUStypically includes the output port address, the source of the packet(SRC), the starting address (SAD) of the packet in the RAM of thecorresponding input port identified by SRC, the TYPE field and WORDCOUNT. Upon completion of step 1105, control is returned to step 1106(FIG. 11). If the test result in step 1121 is NO, the queuing delay atthe output port assigned to OPSRC is satisfactory and operational block1122 selects the output port to be the one assigned to the particularSRC, i.e., OPSRC. Thereafter, step 1105 writes the packet outputinformation on SBUS which, in turn, supplies it to the output portassigned to OPSRC. It is important to note that this process involvesso-called indirect addressing in order to determine which one of outputports 110 is assigned to the particular one of input ports 104 which isinterfaced to the particular signal source (SRC). This is importantbecause a remote node from which the signal may be transmitted has noinformation as to such output port assignments in this particular node.The use of the indirect addressing is important for achieving looptransmissions and the like to establish nearest node (neighbor) tablesand the like.

Returning to step 1118 (FIG. 12), if the test result is NO, the primaryoutput port is not CSRC and conditional branch point 1123 tests todetermine if the primary output port assigned to DEST of the packet isan output port assigned to a so-called conditional extension (CEXT).This is another use of indirect addressing in which it is beingdetermined if the packet is from CEXT, it is sent to the control outputport and if the packet is from the control input, it is sent to theoutput port assigned to conditional extension (CEXT), i.e., to DEST EXT.Thus, if the test result in step 1123 is YES, conditional branch point1124 tests to determine if the input port is assigned to control (CTL).If the test result in step 1124 is NO, the output port is not DEST EXTand control is returned to step 1115. Steps 1115-1117 are repeated todetermine if the output port assigned to control (CTL) is good orwhether the packet is to be supplied to statistics port 116, asdescribed above. If the test result in step 1124 is YES, conditionalbranch point 1125 tests to determine if the output port assigned to DESTEXT is "real", i.e., one of the N (N=1-8) actual output ports in thisnode. If the test result in step 1125 is NO, control is returned to step1104 (FIG. 11) and the packet is supplied to statistics pot 116, asdescribed above. If the test result in step 1125 is YES, the associatedoutput port is DEST EXT and conditional branch point 1126 tests itsstatus. If the test result in step 1126 is NO, the status (DEST EXT) isnot good and control is returned to step 1104 (FIG. 11) and the packetis supplied to statistics port 116, as described above. If the testresult in step 1126 is YES, status (DEST EXT) is good and conditionalbranch point 1127 tests to determine if the queuing delay at the outputport assigned to DEST EXT exceeds a predetermined threshold, namely,whether

    TQSUM(DEST EXT)>TD.                                        (6)

The same conditions apply to TD as described above regarding equation(4). If the test result in step 1127 is YES, the queuing delay is toolong and control is returned to step 1104 (FIG. 11) and the packet issupplied to statistics port 116, as described above. If the test resultin step 1127 is NO, the queuing delay is below the threshold TD andoperational block 1128 selects the output port to be DEST EXT, asidentified in bit positions VCID(16)-VCID(19) in the packet transportword. Thereafter, step 1105 (FIG. 15) writes the packet outputinformation on SBUS which, in turn, supplies it to the appropriateoutput port assigned to DEST EXT. Then, control is returned to step1106. Again, the packet output information written on SBUS typicallyincludes the output port address, the source of the packet (SRC), thestarting address (SAD) of the packet in RAM of the corresponding inputport identified by SRC, the TYPE field and WORD COUNT which is totallength (M+1) of the packet.

Returning to step 1123 (FIG. 12), if the test result is NO, the primaryoutput port is not CEXT and conditional branch point 1129 tests todetermine if the primary output port is DEST EXT. If the test result instep 1129 is YES, conditional branch point 1130 tests to determine ifthe output port assigned to DEST EXT is control (CTL). Again, this isanother example of indirect addressing. If the test result in step 1130is YES, the output port is assigned to control and the process returnsto step 1115. Appropriate ones of steps 1115-1117 are repeated, asdescribed above, to determine if the packet is supplied to either thecontrol output port or statistics port 116. Returning to step 1130, ifthe test result is NO, the output port assigned to DEST EXT is notcontrol and conditional branch point 1131 (FIG. 13) tests to determineif the output port assigned to DEST EXT is assigned to conditionalsource (CSRC). Again, this is another example of indirect addressingwhich is used to locate appropriate output ports in this node forpackets transmitted from a remote node that does not know the portassignments in this node. If the test result in step 1131 is NO, theoutput port assigned to DEST EXT is not CSRC, control is returned tostep 1125 and appropriate ones of steps 1125-1128 are repeated todetermine if the packet is to be supplied to the output port assigned toDEST EXT or to statistics port 116, as described above. If the testresult in step 1131 is YES, appropriate ones of steps 1119-1122 and1115-1117 are repeated to determine if the packet is to be supplied tothe output port assigned to the conditional source, i.e., OPSRC, to thecontrol (CTL) output port or to statistics port 116, as described above.

Returning to step 1129, if the test result is NO, the primary outputport is not DEST EXT and conditional branch point 1132 (FIG. 14) teststo determine if the primary output port is "real", i.e., one of the N(N=1-8) actual output ports in this node. If the test result in step1132 is NO, control is returned to step 1104 and the packet is suppliedto statistics port 116, as described above. If the test result in step1132 is YES, the primary output port is real and conditional branch port1133 tests the status of the one of output ports 110 assigned to theprimary route, i.e., status (P). If the primary output port status isnot good, the test result in step 1133 is NO and conditional branchpoint 1134 tests the status of the output port assigned to the secondaryroute, i.e., status (S). If the test result in step 1134 is NO, controlis returned to step 1104 (FIG. 11) and the packet is supplied tostatistics port 116, as described above. If the test result in step 1134is YES, conditional branch point 1135 tests to determine if the queuingdelay, i.e., number of packet words to be transmitted from the secondaryoutput port, exceeds a predetermined delay threshold TD, namely, whether

    TQSUM(S)>TD.                                               (7)

Again, the value of TD is set so that if the packet is going toexperience more than an acceptable amount of delay in being transmitted,its transmission is terminated at statistics port 116. For example, thevalue of delay threshold TD is set such that, if the packet will beoverwritten in the RAM in the corresponding one of input ports 104 priorto being transmitted from the output port its transmission isterminated. Consequently, delay threshold TD has a relatively highvalue. Thus, if the test result in step 1134 is YES, control is returnedto step 1104 (FIG. 11) and the packet is supplied to statistics port116, as described above. If the test result in step 1135 is NO, thedelay is acceptable and conditional branch point 1136 tests to determineif the packet has been previously alternate routed. This is readilydetermined from the destination of the packet (DEST), which input port(SRC) that the packet was received on and the known system topology.Again, it is important to not alternate route and, if necessary, toterminate transmission of packets that have been previously alternaterouted if they will experience too long a delay in transmission.Termination of transmission of such packets minimizes the likelihoodthat the so-called "funeral effect" can result. As is known, the"funeral effect" causes throughput in the system to become increasinglyless as the load on the system increases. Therefore, terminatingtransmission of packets that have been previously alternate routed whenthe delay in the secondary output port exceeds a predetermined minimumacceptable re-routing theshold TRR increases overall system "good"throughput. Thus, if the test result in step 1136 is NO, the packet hasnot been previously alternate routed and step 1137 selects the secondaryoutput port to transmit the packet. Step 1105 writes the packet outputinformation to SBUS and, then, control is returned to step 1106 (FIG.11). If the test result in step 1136 is YES, the packet has beenpreviously alternate routed and conditional branch point 1138 tests todetermine if the queuing delay TQSUM(S) at the secondary output port isgreater than the predetermined re-routing threshold TRR, namely, whether

    TQSUM(S)>TRR                                               (8)

It is noted that threshold TRR represents some minimal transmissiondelay interval at the secondary output port so that if the packet weresupplied to the secondary output port it would experience only a minimaldelay before being transmitted. Thus, if the test result in step 1138 isYES, the delay is too long, control is returned to step 1104 (FIG. 11)and the packet is supplied to statistics port 116, as described above.If the test result in step 1138 is NO, the delay is acceptable and step1137 selects the secondary output port for transmitting the packet.Thereafter, step 1105 causes the packet output information to be writtenon SBUS and, then, control is returned to step 1106 (FIG. 11).

Returning to step 1133 (FIG. 14), if the primary output port status (P)is good, a YES result is obtained and conditional branch point 1139tests to determine whether the queuing delay at the primary output portexceeds the delay threshold TD, namely, whether

    TQSUM(P)>TD.                                               (9)

Again, the conditions regarding TD are as described above. If the testresult in step 1139 is YES, control is transferred to conditional branchpoint 1141. If the test result in step 1139 is NO, control istransferred to conditional branch point 1140 (FIG. 15).

Conditional branch point 1141 (FIG. 14) tests to determine whether thepacket is a so-called type 1, i.e., periodic packet. This is achieved bydetermining if bit position TYPE (1) includes a logical 1. If so, thispacket is periodic. This test is important because it is not desirableto terminate transmission of periodic packets. If the test result instep 1141 is NO, the packet is statistical and appropriate ones of steps1134-1138 and 1104 are performed, as described above. If the test resultin step 1141 is YES, the packet is periodical and conditional branchpoint 1142 tests to determine if the primary output port assigned to thepacket DEST has a reserved interval for the transmission of periodicpackets, namely, whether

    RESQSUM(P)>0.                                              (10)

If the test result in step 1142 is YES, operational block 1142 (FIG. 15)selects the primary output port to transmit the packet. Thereafter,operational block 1105 causes the packet output information, asdescribed above, to be written on the SBUS and, then, control isreturned to step 1106 (FIG. 11).

If the test result in step 1142 is NO, conditional branch point 1144tests the status of the secondary output port assigned to the packetDEST, namely, status(s). If the test result in step 1144 is NO, thestatus (S) is not good, control is returned to step 1104 (FIG. 11) andthe packet is supplied to statistics port 116, as described above. Ifthe test result in step 1144 is YES, the status (S) is good andconditional branch point 1145 tests to determine if the packet is aminimum delay type. This test is achieved by interrogating bit positionTYPE (4) to determine whether or not it is a logical 1. A logical 1indicates that the packet has a minimum delay class of service assingedto it. It is noted that both periodic and statistical packets can beassigned a class of service requiring minimum delay. If the test resultin step 1145 is NO, the packet (FIG. 11) is not a minimum delay type,control is returned to step 1104, and the packet is supplied tostatistics port 116, as described above. If the test result in step 1145is YES, the packet is a minimum delay type and conditional branch point1146 tests to determine if the secondary output port assigned to thepacket DEST has a reserved interval for the transmission of periodicpackets, namely, whether

    RESQSUM(S)>0.                                              (11)

If the test result in step 1146 is YES, there is an interval reservedfor transmitting periodic packets, control is returned to step 1136(FIG. 15) and appropriate ones of steps 1136-1138 (FIG. 19) and 1104(FIG. 11) are repeated to determine if the secondary output port is tobe selected to transmit the packet or whether the packet is supplied tostatistics port 116, as described above. In turn, step 1105 causes thepacket output information, as described above, to be written on theSBUS. Thereafter, control is returned to step 1106 (FIG. 11). If thetest result in step 1146 is NO, there is no interval reserved fortransmitting periodic packets, control is returned to step 1135 andappropriate ones of steps 1135-1138 and 1104 are repeated to determinewhether the secondary output port is selected to transmit the packet orwhether the packet is supplied to statistics port 116, as describedabove. In turn, step 1105 causes the packet output information to bewritten on SBUS. Then, control is returned to step 1106 (FIG. 11).

Conditional branch point 1140 (FIG. 15) also tests to determine if thepacket is a type 1, i.e., periodic packet, as described above. If thetest result in step 1140 is YES, the packet is periodic and conditionalbranch point 1147 tests to determine if the primary output port assignedto the packet DEST has a reserved interval for the transmission ofperiodic packets, in accordance with equation (10). If the test resultin step 1147 is YES, step 1143 selects the assigned primary output portto transmit the packet, step 1105 writes the packet output informationto SBUS, as described above, and control is returned to step 1106 (FIG.11). If the test result in step 1147 is NO, conditional branch point1148 tests to determine if the packet is a minimum delay type, asdescribed above. If the test result in step 1148 is NO, steps 1143 and1105 are effected, as described above, and control is returned to step1106 (FIG. 11). If the test result in step 1148 is YES, conditionalbranch point 1149 tests the status of the secondary output port assignedto the packet DEST, namely, status (S). If the test result in step 1149is NO, steps 1143 and 1105 are effected, as described above, and controlis returned to step 1106 (FIG. 11). If the test result in step 1149 isYES, conditional branch point 1150 tests to determine if the secondaryoutput port assigned to the packet DEST has a reserved interval for thetransmission of periodic packets in accordance with equation (11). Ifthe test result in step 1150 is YES, step 1137 selects the secondaryoutput port to transmit the packet, step 1105 writes the packet outputinformation to SBUS and control is returned to step 1106 (FIG. 11). Thisfollows because the secondary output port will have the least delay intransmitting the packet. If the test result in step 1150 is NO,conditional branch point 1151 tests to determine which one of theprimary and secondary output ports has less delay, in accordance with anaspect of the invention, by comparing the actual queuing delay, i.e.,amount of packet information to be transmitted, at each of the primaryand secondary output ports relative to a predetermined threshold TA andthe delay difference DD between the primary and secondary routesassigned to the packet DEST. The relationship is whether

    TQSUM(P)-TQSUM(S)>TA+DD.                                   (12)

The value of threshold TA is selected to be a value significantly lowerthan the delay threshold TD and such that the packet is notunnecessarily routed to the secondary route. This minimizes thepossibility of the so-called "funeral effect" resulting. Again, the"funeral effect" is a condition that results in lower and lower networkthroughput because of packets being alternate routed. Consequently, asnetwork loading increases system "good" throughput decreases. If thetest result in step 1151 is NO, the primary output port has the leastdelay, step 1143 selects the primary output port to transmit the packet,step 1105 writes the packet output information to SBUS and control isreturned to step 1106 (FIG. 11). If the test result in step 1151 is YES,the secondary output port has the least delay, control is returned tostep 1136 and appropriate ones of steps 1136-1138 and 1104 are repeatedto determine whether the secondary output port is selected to transmitthe packet or whether the packet is to be supplied to statistics port116, as described above. Thereafter, control is returned to step 1106(FIG. 11).

Returning to step 1140, if the test result is NO, the packet isstatistical and conditional branch point 1152 tests to determine if thepacket is a minimum delay type, in a manner as described above. If thetest result in step 1152 is NO, the packet is not a minimum delay type.Step 1143 selects the primary output port to transmit the packet.Thereafter, step 1105 writes the packet output information to SBUS andcontrol is again returned to step 1106 (FIG. 11). If the test result instep 1152 is YES, the statistical packet has been assigned a minimumdelay grade of service and conditional branch point 1153 tests thesecondary output port status, i.e., status (S). If the test result instep 1153 is NO, the status (S) is not good and step 1143 selects theprimary output port to transmit the packet. This follows because thesecondary output port is not available and, hence, the primary routewill have the least delay. Again, step 1105 writes the packet outputinformation to SBUS and, thereafter, control is returned to step 1106.If the test result in step 1153 is YES, conditional branch point 1154tests to determine which one of the primary and secondary output portshas less delay in accordance with equation (12), described above. If thetest result in step 1154 is NO, the primary output port has less delayand step 1143 selects it to transmit the packet. Again, step 1105 writesthe packet output information to SBUS and, thereafter, control isreturned to step 1106. If the test result in step 1154 is YES, thesecondary output port has less delay, control is transferred to step1136 and appropriate ones of steps 1136-1138 and 1104 are repeated todetermine whether the secondary output port is selected to transmit thepacket or whether the packet is to be supplied to statistics port 116,as described above. Thereafter, step 1105 writes the packet outputinformation to SBUS and control is then returned to step 1106.

OUTPUT LOCAL PACKET INTERFACE

Output local packet interfaces 112-1 through 112-Y (FIG. 1) are employedto interface output ports 110-(X+1) through 110-(X+Y), respectively, toparticular apparatus and/or communications links as desired via outputterminals 115-(X+1) through 115-(X+Y), respectively. As indicated above,the apparatus and/or communications links being interfaced, correspondto those interfaced by input local packet interfaces 106 in packetizers105-1 through 105-Y. This follows because there is a need for two waycommunication between the apparatus and/or communication links beinginterfaced. To this end, each of output ports 110-(X+1) through110-(X+Y) supplies the packet information a byte at a time along with astart of packet (SOP) signal and a STUFF signal to an associated one ofoutput local packet interfaces 112. Each of output local packetinterfaces 112 supplies an ENABLE OUT signal to its associated one ofoutput ports 110. The ENABLE OUT signal is at a packet byte rate andindicates to the associated output port that the output local packetinterface is ready to receive a packet byte. Each of output local packetinterfaces 112 includes apparatus for depacketizing the supplied packetsand for supplying the depacketized information in an appropriate signalformat for the apparatus and/or communications link being interfaced.The SOP signal indicates the beginning of the packet so that it can beproperly depacketized. The STUFF signal indicates whether the packetcould be ignored. Apparatus to be included in individual ones of outputlocal packet interfaces 112 will depend on the particular apparatus orcommunication link being interfaced and will be apparent to thoseskilled in the art.

NETWORK

FIG. 16 depicts a network, in simplified form, which advantageouslyutilizes aspects of the invention. It is noted that there is two waycommunication between elements forming the network. Accordingly, shownare private networks 1601 and 1602, so-called local networks 1603 and1604 and higher layer network 1605. Although only two layers in thepublic system hierarchy are shown, it will be apparent to those skilledin the art that any number of layers may be employed as needed ordesired in the overall network. Each of private networks 1601 and 1602may include a number of switching and access packet network nodesincluding aspects of the invention. For example, private networks 1601and 1602 may be those of a particular transport network user and belocated at diverse geographic locations. The broadband packets generatedin the private networks are identical to those described in relation topacket network node 100 and employed in networks used in the publicsystem. A particular private network is assigned a unique reference codeword Xref in order to identify its packets and to provide transparencyfor all other information being transmitted. The broadband packetssupplied to and from private network 1601 and another apparatus and/orcommunication links are supplied to an access packet network node (AN)1606. In turn, access node 1606 supplies packets to and receives packetsfrom a switching packet network node (SN) in local network 1603. Asindicated above, the packets from private network 1601 and signals fromother interfacing apparatus appear as information and are formatted intobroadband packets by a packetizer in access node 1606. These broadbandpackets are generated using a unique reference code word Xref assignedto local network 1603. The packets in local network 1603 may traverseseveral switching nodes (SN) or be supplied to some other apparatus,network or transmission facility interfacing local network 1603 viaaccess node 1606 or some other access node (not shown). If the packetsare destined for some other local network, for example, network 1604,they will be supplied via gateway node 1607 to higher layer network 1605and, therein, to a switching node (SN). In gateway node 1607, a newtransport word is appended to each packet which has been generated usinga unique reference code word assigned to higher layer network 1605. Thisappending can be achieved by simply adding another transport word to thepackets or by stripping off the previous transport word and adding a newone generated in gateway node 1607. Similarly, if packets are beingsupplied from higher layer network 1605 to local network 1603, gatewaynode 1607 would strip the higher layer network transport word which hadbeen added or if the transport word was replaced dropping the higherlayer network transport word and adding a transport word generated withthe reference code word Xref assigned to local network 1603. If thepackets being transmitted in higher layer network 1605 are destined forlocal network 1604, they are supplied thereto via gateway node 1608.Gateway node 1608 performs the same functions as gateway node 1607. Inlocal network 1604, the packets are supplied via one or more switchingnodes to access node 1609. Access node 1609 supplies the packets to aspecific apparatus, transmission facility or private network 1602.Again, the packets destined for private network 1602 include transportwords generated by using a unique reference code word Xref assigned tothe private network transport user. Consequently, the packets will berecognized in private network 1602. Therefore, it is seen that theprivate network packets can be readily identified by use of the uniquereference code word and still transmit the private network packets on atransparent basis through the broadband packet network hierarchy.

We claim:
 1. Apparatus for supplying information packets as an output,comprising:means for obtaining output information for individualarriving packets; at least first queue means for storing prescribedoutput information for individual packets designated a first type; atleast second queue means for storing prescribed output information forindividual packets designated a second type; means responsive toprescribed output information of said arriving packets for generating ascheduled time of service for each of said arriving packets designatedsaid second type; and means responsive to each said scheduled time ofservice and said prescribed output information stored in said at leastfirst queue means and said at least second queue means for controllablysupplying packets as an output of said first type and of said secondtype, respectively, wherein individual ones of said second type packetshaving said prescribed output information stored in said at least secondqueue means are not supplied as an output at least until a correspondingcomputed scheduled time of service has occurred and wherein individualones of said first type packets having said prescribed outputinformation stored in said at least first queue means are supplied as anoutput otherwise.
 2. The apparatus as defined in claim 1 wherein saidobtained output information for each of said arriving packets includes arepresentation of the length of a corresponding arriving packet andwherein said means for generating generates said scheduled time ofservice based on said packet length representations.
 3. The apparatus asdefined in claim 2 wherein said means for generating includes means forgenerating a reserved interval associated with each arriving second typepacket and being proportional to the length of said associated arrivingsecond type packet, wherein said reserved interval is reserved to supplyfirst type packets as an output.
 4. The apparatus as defined in claim 3wherein said reserved interval is proportional to a reservation factorrepresentative of a percentage of first type packets being supplied asan output.
 5. The apparatus as defined in claim 4 wherein said firsttype packets are periodic packets and said second type packets arestatistical packets.
 6. The apparatus as defined in claim 4 wherein saidmeans for generating said reserved interval generates said reservedinterval in accordance with

    RI=(k/1-k)(M+1)

where RI is said reserved interval, k is said reservation factor and(M+1) is the length of said associated second type packet.
 7. Theapparatus as defined in claim 4 further including means for generatingsaid reservation factor in response to first type packet words beingsupplied as an output during a predetermined interval.
 8. The apparatusas defined in claim 4 wherein said means for controllably supplyingincludes means responsive to said generated scheduled times of serviceand said prescribed output information in said at least first queuemeans and said at least second queue means for supplying as an outputstuff packets during said reserved intervals when no prescribed outputinformation for said first type packets is stored in said at least firstqueue means.
 9. The apparatus as defined in claim 8 wherein said meansfor generating generates each said scheduled time of service inaccordance with

    STOS=T+TQSUM

where STOS is said scheduled time of service, T is arbitrary time, e.g.,now, in packet words and TQSUM is representative of a total interval inpacket words accumulated for supplying packets of said first type andsaid second type as an output accoding to

    TQSUM=REAL QSUM+RESQSUM

where REAL QSUM is an accumulation of lengths in packet words of firsttype packets having prescribed output information stored in said atleast first queue means and of second type packets having prescribedoutput information stored in said at least second queue means less firsttype and second type packet words that have been supplied as an outputand where RESQSUM is an accumulation representative of said generatedreserved intervals in packet words less lengths in packet words of anyfirst type packets having said prescribed output information stored insaid at least first queue means and less any stuff packet words whichhave been supplied as an output.
 10. The apparatus as defined in claim 9wherein said first type packets are periodic packets and said secondtype packets are statiatical packets.